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Multistability, local pattern formation, and global collective firing in a 
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We investigate numerically the collective dynamical behavior of pulse-coupled non-leaky integrate- and- fire- 
neurons that are arranged on a two-dimensional small- world network. To ensure ongoing activity, we impose 
a probability for spontaneous firing for each neuron. We study network dynamics evolving from different 
sets of initial conditions in dependence on coupling strength and rewiring probability. Beside a homogeneous 
equilibrium state for low coupling strength, we observe different local patterns including cyclic waves, spiral 
waves, and turbulent-like patterns, which - depending on network parameters - interfere with the global 
collective firing of the neurons. We attribute the various network dynamics to distinct regimes in the parameter 
space. For the same network parameters different network dynamics can be observed depending on the set 
of initial conditions only. Such a multistable behavior and the interplay between local pattern formation and 
global collective firing may be attributable to the spatiotemporal dynamics of biological networks. 



Pattern formation in neural networks plays 
a prominent role in understanding physiologi- 
cal and pathophysiological aspects of mammalian 
hearts and brains. In the case of the heart, nor- 
mal functioning is determined by collective os- 
cillations of the contributing cardiac cells, while 
ventricular and atrial fibrillation is related to the 
emergence of spiral wave patterns. People that 
suffer from migraine or are influenced by certain 
drugs report on spiral wave patterns during visual 
hallucination, and these patterns can even be ob- 
served in the neuronal activity of the mammalian 
cortex. In addition, a multitude of brain disorders 
such as epilepsy, schizophrenia, autism, migraine, 
and Alzheimer's and Parkinson's disease are as- 
sociated with abnormal collective firing emerging 
from neural tissue. We here observe the cooccur- 
rence of local wave patterns and global collective 
firing in a two-dimensional small-world network 
composed of simple model neurons. Our obser- 
vations might be of relevance to gain deeper in- 
sights into how the spatiotemporal dynamics of 
brain disorders (e.g. epileptic seizures) depends 
on both the dynamic properties of neural ele- 
ments and the topology of synaptic wiring. 



I. INTRODUCTION 

A regular lattice with the local dynamics of ex- 
citable elements is called excitable medium^^^. Sys- 
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tems that have been modeled as excitable media are 
ubiquitous in nature, ranging from isothermal chemi- 
cal reactions^ via disease spreading among a popula- 
tion of living organisms^ to the mammalian heart^^^ and 
brain systems^"— . For many natural systems, however, 
the consideration of regular lattices may not yield an 
adequate description given that distant elements may 
interact. Watts and Strogatz introduced model net- 
works that take into account both local and long-range 
interactions^. The authors start with a regular lattice 
and rewire some of the connections to random positions 
yielding a small-world configuration. Varying the frac- 
tion of rewired connections allows to interpolate contin- 
uously between regular lattices and random networks. 
This scheme has inspired many studies onto how the dy- 
namics of coupled, complex networks changes along this 
interpolationi^r— . 

Small-world models have recently been shown to pro- 
vide a useful framework that may help to improve our 
understanding of structure and function of human brain 
systems Apart from the underlying network topol- 
ogy the dynamical properties of network elements can be 
regarded crucial for the collective dynamical behavior. 
Many neuron models have been proposed with varying 
numerical complexit y "'^^i-'^^ . Especially for detailed mod- 
els and large networks, feasibility is easily lost. However, 
qualitative observations are often transferable between 
different neuron models, and even simple models like the 
integrate-and-fire (IF) neuron^^^^^ are powerful tools in 
understanding the information processing capabilities of 
real neurons. Despite their simplicity, analytical results 
for the global dynamical behavior of IF neuron networks 
are limited to special cases, mostly considering homo- 
geneous configurations like all-to-all coupling^^, random 
networks^, or population models^^. For lattices, wave 
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propagation and spiral waves can be observed^^, and it 
is possible to perform a continuum limit, describing the 
medium in the form of a partial differential equation^^. 
For the small- world regime, however, it is not clear how 
such a description can be achieved thus rendering numer- 
ical simulations inevitable (see e.g.^^). 

To ensure ongoing activity in the medium, neurons are 
usually excited via some noise input. The existence of 
an optimal noise level for wave phenomena is called co- 
herence resonance and has been extensively studied, also 
more recently for small- world media^^^^. In two or more 
dimensions, the formation of self-sustaining activity such 
as spiral waves and irregular turbulent-like patterns is 
possible, even in the absence of an external input. In 
small- world media self-sustaining activity is also possible 
for one spatial dimension if the chosen setup allows for 
a balance between wave propagation and creation due 
to long-range excitations^^'^^. More recently, it was re- 
ported that waves in a one-dimensional small-world net- 
work of phase oscillators can prevent synchronous mo- 
tion for sufficiently large coupling strength and few ran- 
dom connections^^. Similarly, a sharp transition between 
wave- dominated behavior for few random connections 
and collective periodic behavior for many random con- 
nections was observed for a two-dimensional coupled map 
lattice of excitable elements^^. 

Our work focuses on such transitions. Instead of strict 
nearest-neighbor coupling, however, we here consider the 
case of a radius of influence for nodes on the regular lat- 
tice which underlie our small- world networks. This choice 
is motivated by neuroanatomy (cf j^^i^^ ) and leads to a 
compHcated dependence of the dynamics (e.g. the prop- 
agation speed of waves (c.f.^^)) on the coupling strength. 
For each node we here consider non- leaky IF neurons, 
and we impose a probability for spontaneous firing to 
each neuron which can be thought to arise from incom- 
ing synaptic excitation from outside the network. We 
study the occurring patterns and their influence on the 
transition between wave-dominated firing and global col- 
lective firing of neurons. We distinguish between self- 
sustaining patterns like spiral waves, which emerge due 
to local excitations, and cyclic waves, which emerge due 
to long-range excitations. 

This article is organized as follows. In Sec. |TT]we give a 
detailed description of our dynamical system and the cho- 
sen observables. In Sees. IIII Al and IIIIBI we discuss the 
behavior for regular lattices and random networks sepa- 
rately before continuing with the investigation of small- 
world networks in Sec. IIII CI We finally draw our con- 
clusions in Sec. IIVI 



II. METHODS 

We here consider a two-dimensional regular lattice of 
N = 300 X 300 identical, non-leaky IF neurons. Two dif- 
ferent neurons are said to be connected if their Euclidean 
distance is smaller or equal than the radius of influence 



R. In the following we present our findings for cyclic 
boundaries and note that we observed similar dynamical 
behavior for open boundaries. We also note that we ob- 
tained qualitatively similar findings for smaller network 
sizes (100 X 100 and 200 x 200 neurons) and thus ex- 
pect that our findings carry over to larger network sizes. 
Starting from this configuration, every directed connec- 
tion is removed with probability p G [0,1] and a con- 
nection between two randomly chosen, unconnected neu- 
rons ni n2 is introduced. With this rewiring scheme 
the mean degree d is independent on p. For two neurons 
ni, n2 that are connected via a synapse from ni to n2, we 
write ni <n2. The dynamical state of each neuron in the 
network at time t is fully determined by its membrane po- 
tential Xn{t). Negative values of Xn signify refractoriness; 
neurons for which Xn^^ fire and increase the membrane 
potential of all neurons n' with n<n' by the global cou- 
pling strength c. The number of time steps during which 
neurons remain refractory after firing will be denoted by 
r. To every neuron n we associate a bimodal random 
variable r]n{t), which takes a value of 1 with probability 
Ps and otherwise. r]n{t) determines the times at which 
neuron n fires spontaneously. We define for every neuron 
n the number of firing neurons which are connected by 
incoming synapses as fn{t) = \{n'\xn'{t) > i^^n' <n}\ . 
The dynamics of neuron n in discrete time t can now be 
described as: 



Xn{t^l) < 



Xnit) 
Xn{t) 



1 



Cfn{t) 



Xnit) < 0, 
{)<Xn(t) <^, 
Xn{t) >l9. 



After choosing a membrane potential Xn{0) for every 
neuron as its initial condition, the coupled dynamical sys- 
tem is iterated for T time steps. Mostly, we will consider 
here the evolution of a homogeneous state with identical 
membrane potentials for all neurons, i.e. Xn{0) = 0. 

As observable we use the fraction of firing neurons per 
time step A{t)^ which will be denoted as network activity. 
In Fig. [T]we present exemplary snapshots from the tem- 
poral evolution of the spatial distribution of membrane 
potentials along with the network activity for different 
dynamical scenarios. 

As only the ratio between c and i9 influences the dy- 
namics, we set, for the sake of simplicity, 19 = 10 in all 
simulations. Note, that large values of R and r increase 
the size of all wave phenomena. Therefore, a trade-off be- 
tween discretization and finite-size-effect has to be made 
and we chose r = 5 and R = ^/TO- For this choice every 
neuron in the middle of the lattice is connected to 36 neu- 
rons. The probability for spontaneous firing was chosen 
to be small in the sense that the influence on the dynam- 
ics is mainly to ensure that the activity in the medium 
does not die out. We set ps = 0.001. The remaining two 
free system parameter, namely the coupling strength c 
and the rewiring probability p, were varied in our simu- 
lations to estimate their influence on the dynamics. We 
will refer to a small- world network with the local dynam- 
ics of an excitable element as small-world medium. 
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A cyclic waves, p — 0.2, c = 1.5 




B spiral waves, p = 0.35,c=1.5 




C turbulent-like waves, p = 0.25,c = 0.6 




D cyclic waves, collective firing, p = 0.3,c = 1.5 




E self-sust. patterns, collective firing, p — 0.45, c = 1.5 




FIG. 1. (Color online) Exemplary snapshots of the spatial distribution 
of membrane potentials (left) together with the corresponding network 
activity A{t) (right) for small- world networks with different rewiring 
probabilities p and coupling strengths c. Initial conditions: XniS^) — 0- 
In the snapshots neurons are indicated as points on the coordinates of 
the underlying lattice. Red points correspond to firing neurons, blue 
points indicate refractory neurons, and gray points denote charging 
neurons with lightness encoding the membrane potential. A: Several 
foci emit cyclic waves at a specific temporal order. Colliding waves 
annihilate because of the refractoriness of the medium. The resulting 
network activity is of small variance. B: Spiral waves dominate the dy- 
namics. They lead to a network activity A{t) with small variance but 
the temporal average is slightly increased as compared to cyclic waves. 
C: The dynamics shows irregular turbulent-like patterns leading to a 
network activity with small variance. D: The majority of the neurons 
charge and fire collectively. Randomly, cyclic waves are created. The 
corresponding network activity shows a periodic behavior. E: Mostly 
collective firing of neurons with some self-sustaining patterns and pe- 
riodic network activity. 



In parts D and E of Figs [T] a large fraction of neurons 
charges and fires collectively, which leads to alternating 
periods of low and high network activity. We will connote 
such an oscillatory behavior with global synchrony and 
distinguish it from a behavior as in parts A, B, and C of 
Fig. [TJ where the network activity exhibits only minor 
fluctuations over time. In order to classify the network 
dynamics, we define the following order parameter which 
takes large values for global synchrony: 

r = max(A(t)|0 < t < T) - mm{A{t)\0 <t<T). 

For large observation times T and stationary dynamics, r 
converges to the dynamical range of A. Note, that r does 
not allow to differentiate between random and periodic 
network activities. However, the observed activities dis- 
play large dynamical ranges of A always combined with 
periodicity, which allows us to use this simple ansatz to 
detect collective firing of neurons. To account for tran- 
sients, we ignore the first 2000 time steps of observa- 
tion. We mention though that special care has to be 
taken since the observed system dynamics may change 
for certain parameter settings even after long periods of 
stationarity. 

Note that the characteristic time scale of the system 
is determined by different mechanisms for cyclic waves 
and for spiral wave or turbulent-like patterns. For cyclic 
waves the formation of a wavefront is caused by non-local 
inputs from spontaneous firing and long-range connec- 
tions: For spiral waves and turbulent-like patterns the 
formation is caused by local connections and is in a wide 
parameter range nearly independent on and p. There- 
fore, we expect different wave densities for both behav- 
iors. Due to the ability of spiral waves and turbulent-like 
patterns to sustain even without external input (ps = 0), 
we will denote both of them as self-sustaining patterns. 
To distinguish between cyclic waves and self-sustaining 
patterns we use the mean firing rate m: 

1 ^ 

III. RESULTS 
A. Lattices 

For lattices, the dynamics is governed by local pat- 
tern formation known from excitable media. We observe 
random firing, more complex turbulent-like patterns as 
well as cyclic or spiral waves depending on the coupling 
strength c and on the chosen set of initial conditions. 
Note that wave propagation in the medium requires a 
minimal coupling strength, which can be estimated for 
a wave traveling in either vertical or horizontal direction 
through an unexcited medium. Given our choice of the 
radius of influence R = VTO, every neuron is connected 
to 15 neurons from the three rows below, to 15 neurons 
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FIG. 2. (Color online) A (upper part): Order parameter r (blue) 
and mean firing rate m (black) dependent on coupling strength c for 
a regular lattice. Initial conditions: Xn{0) = 0. Red symbols indicate 
values of m and r that originate from changes of the dynamical behav- 
ior during the observation time. The systems were observed for 8000 
time steps with 20 realizations for each coupling strength. A (lower 
part): Snapshots of the spatial distribution of membrane potentials for 
different coupling strength (color coding as in Fig0). B: Same as in A 
but for open wave endings as initial conditions as described in Fig. \3\ 
For c < 0.28 the dynamics for both sets of initial conditions is domi- 
nated by spontaneous firing and we observe no pattern (regime I). For 
0.28 < c < 0.6 both sets of initial conditions lead to self-sustaining pat- 
terns (regime II). For c > 0.6, the initial conditions Xn(0) = lead to 
cyclic waves (regime III), while open wave endings lead again to self- 
sustaining patterns (turbulent-like patterns and spiral waves). Note 
that because of the discrete nature of the observed dynamical system, 
the dynamics does not depend continuously on the coupling strength; it 
only changes when crossing a fraction of the threshold potential, which 
is refiected by stepwise constant firing rates m. 



from the three rows above, and to 6 neurons in the row 
of the considered neuron. This leads to a minimal cou- 
pling strength of ^ = 0.67. For a medium that is already 
somewhat excited, wave propagation may be possible be- 
low this threshold. 

With the set of initial conditions Xn{0) = for all neu- 
rons, the mean firing rate m and the order parameter 
r depend discontinuously on the coupling strength (cf. 
Fig. [2lA.), and the medium shows different dynamical be- 
haviors. Starting at c = the dynamics is dominated 
by spontaneous firing of neurons. Here, the membrane 
potentials of the neurons in the charging state (with 
< Xn{t) < 1^) are distributed around their mean value 
which we denote as mean excitation in the network. 
As a spontaneously firing neuron reenters the charging 
state with Xn{t) = after the refractory period, the in- 
fluence of the firing on the mean excitation amounts to 
A = l/N{—x{t) + dc). The mean excitation x{t) satu- 
rates for A = when charged by spontaneous firing only. 
From this condition the saturation potential x can be es- 
timated as X = dc. If X < 1? or c < I = ^ = 0.28 




ICfTe) 
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FIG. 3. (Color online) Consecutive snapshots of the spatial distribu- 
tion of membrane potentials for a regular lattice with coupling strength 
c = 1.0 and without spontaneous firing. The initial conditions are de- 
fined as follows: Xn{0) = — r for the neurons in the left and the right 
third of the lattice, XniO) = for neurons in the upper and lower part 
of the middle third, and Xn{0) — i9 for the remaining neurons (color 
coding as in Fig. fl]) . 



the charging saturates before the majority of neurons 
reach their threshold potential. Thus the dynamics is 
characterized as a homogeneous equilibrium without any 
observable pattern (regime I). For 0.28 < c < 0.6 the 
dynamics gradually changes to turbulent-like patterns 
(regime II). Here, the medium is excited in a compli- 
cated way, and wave propagation is partially possible. 
The patterns preserve themselves because waves die out 
and leave the medium somewhat excited or because wave 
propagation is so slow that the neurons in the tail of the 
wave recover from their refractory period and get ex- 
cited again. This dynamical behavior relies on R and 
r being of similar order of magnitude and can probably 
only be observed for > 1. Note that for c > 0.47 
these turbulent-like patterns sustain even in the absence 
of external input (ps = 0). For c > 0.6, turbulent-like 
patterns do not appear anymore. Instead the medium is 
charged homogeneously (by the spontaneous firing) until 
at regions cyclic waves appear clearing large parts of the 
medium again from excitement (regime III). Given our 
choice of parameters the charging of the medium is slow 
as compared to the formation of turbulent-like patterns, 
which is reflected by a decreased mean firing rate m. 

In contrast, when starting from a set of initial condi- 
tions as depicted in Fig. [3] the mean firing rate m in- 
creases monotonously with the coupling strength c and 
self-sustaining patterns can still be observed for c > 0.6 
(cf. Fig[2p). Here, the dynamics of the lattice is charac- 
terized by four open endings of two wavefronts that bend 
and create turbulent-like patterns. For larger coupling 
strengths the patterns become more regular until four 
spiral wave foci remain for coupling strengths c > 0.8. 

For both sets of initial conditions the order parameter 
r takes on small values only as we do not observe global 
oscillations on our lattices. 



B. Random networks 

We generated random networks by connecting every 
pair of nodes with a fixed connection probability p. Al- 
though this leads to slightly varying total number of con- 
nections per realization, the random networks will be in- 
dexed here by their expected mean number of connec- 
tions per neuron d = pN (i.e., the mean degree). We 
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FIG. 4. (Color online) Order parameter r (blue) and mean firing rate 
m (black) dependent on the coupling strength c for a random network 
with mean degree d = 36. For c > 0.28 network activity A{t) shows 
periodic behavior (regime b), while for smaller coupling strengths the 
network activity shows only minor fluctuations (regime a). We observe 
no dynamical changes during the observation time. 
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FIG. 5. Order parameter r dependent on the coupling strength c 
and inverse mean degree 1/d for a network of 90000 randomly coupled 
neurons. The system was observed for 8000 time steps. 



observe two regimes that do not depend on the choice of 
the initial conditions. For smah couphng strengths c the 
network activity A{t) is of smah variance (regime a), and 
for large c it shows a periodic behavior (regime b). Both 
dynamics are separated in parameter space by a critical 
coupling strength, which will be denoted by Cc. 

The dependence of the order parameter r on the cou- 
pling strength c shows the typical behavior known from 
other synchronization phenomena^^. We present this de- 
pendence in Fig. m for d = 36, which is the same mean 
number of connections as studied with regular lattices. 
The mean firing rate m takes on similar values as ob- 
served for cyclic waves on a lattice. Interestingly, m ex- 
hibits a local maximum at Cc. 

From the dependence of the order parameter r on the 
mean degree d and on the coupling strength c (cf. Fig. [5]), 
we observe that Cc can be described with the parameters 
of the system in a simple way: dcc = i^. As with regular 
lattices spontaneous firing charges the mean excitation 
in the network x{t) only until x = dc. If the charging 
saturates below the firing threshold (i.e., for dc < i^) 
neurons do not fire collectively. Note that as considered 



iiiS^, a probability for an excitation instead of for firing, 
would lead to an effective charging of the medium inde- 
pendently of x(t), and global oscillations of the network 
activity could be observed for c < i9/d. The critical cou- 
pling Cc also marks the threshold at which the network 
becomes non-dissipative in the sense that each neuron 
distributes more excitation than was needed to make it 
fire; in the case of IF neurons in continuous time and 
without refractoriness, coupling strengths c > Cc would 
lead to divergent behavior. 



C. Small-world networks 

Before presenting our findings for the transition be- 
tween regular lattices and random networks we briefly 
recall the main findings for the limiting cases. On a reg- 
ular lattice we observe - for homogeneous initial condi- 
tions - different local patterns depending on the coupling 
strength c. For small c we observe random firing (regime 
I), for intermediate c self-sustaining patterns (regime II) 
and for large c cyclic waves (regime III). The transition 
between regimes II and III can be assessed by a discon- 
tinuity in the dependence of the mean firing rate m on 
c. 

For random networks we observe - independent of the 
initial conditions - a smooth transition between constant 
(regime a) and periodic network activities (regime b), as 
assessed by the order parameter r. The different dynam- 
ical behaviors can be expected to be carried over into the 
small- world regime and thus allow one to investigate the 
interplay between local patterns and global oscillations. 

First, we discuss the temporal evolution of the set of 
homogeneous initial conditions {xn{0) = for all neu- 
rons). In Fig. [6] we present the dependence of the mean 
firing rate m and of the order parameter r on the rewiring 
probability p for a fixed coupling strength c = 1.5. We 
can separate four different regimes. Transitions between 
regimes can be assessed as discontinuities in m and r. For 
each of the regimes, a snapshot of the spatial distribu- 
tion of membrane potentials is presented in Fig. [TJ The 
dynamical behavior in these regimes differs in the local 
patterns (as observed in II and III on regular lattices) 
and in whether the medium exhibits global oscillations 
(as observed in a and b on random networks). We thus 
denote these regimes as Ila, lib. Ilia, and Illb. 

For small p we observe no global oscillations. This 
is due to the influence of cyclic waves and could be ex- 
plained by the following considerations. A wave will clear 
any excitement it passes on the medium. If the charac- 
teristic time tw for a region of the medium between the 
passing of two waves is smaller than the time to that is 
needed to charge this region due to rewired connections 
and spontaneous firing, then the dynamics will evolve to a 
wave- dominated state with constant activity. With more 
rewired connections to decreases. Therefore, t^ = to for 
some p and the global oscillations become stable (transi- 
tion between regime Ilia and Illb). 
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FIG. 6. (Color online) Order parameter r (blue) and mean firing rate 
m (black) dependent on the rewiring probability p for a small-world 
medium with coupling strength c = 1.5. Red symbols indicate values 
of m and r that originate from dynamical changes during the observa- 
tion time. Initial conditions: cc^(O) = for all neurons. The system 
was observed for 8000 time steps, and 10 realizations with difTerent 
random seeds for rewiring and spontaneous firing were simulated for 
each p. Four different regimes can be observed. Regime Ilia: no global 
oscillations, cyclic waves (cf. Fig. fTK)- Regime Illb: global oscilla- 
tions, cyclic waves (cf. Fig. fTD). Regime Ila: no global oscillations, 
self-sustaining patterns (cf. Fig. fTt3). Regime lib: global oscillations, 
self-sustaining patterns (cf. Fig. \T^). 



With more rewired connections also the number of 
local connections is diminished. At a certain rewiring 
probability the patterns change from cyclic waves to self- 
sustaining patterns. Especially after the global firing, 
waves get so slow that the neurons in the tail recover 
from their refractory period and get excited again. This 
excitation eventually forms a second wave, which collides 
with the refractory tail of the first wave creating spi- 
ral wave foci. As self-sustaining patterns lead to larger 
wave densities, is diminished abruptly and the dynam- 
ics gets dominated by waves again (transition between 
regime Illb and Ila). 

A wave in a medium exhibiting global oscillations will 
be moved backward by each oscillation for a distance it 
moves in the refractory period. This is because refrac- 
tory neurons in the tail of a wave will not participate 
in the global collective firing and subsequently, the wave 
will reemerge behind this tail. Additionally, the propa- 
gation speed of a wave depends on the excitation of the 
medium. Therefore, speed will increase on the way to 
collective firing or a wave will only move part of the time 
when the membrane potentials are already charged. At 
a certain rewiring probability the waves get so slow that 
they practically do not move anymore. For this rewiring 
probability global oscillations become stable again (tran- 
sition between regime Ila and lib). Although some wave 
phenomena remain in regime lib, their portion dimin- 
ishes rapidly with increasing p. 

In upper part of Fig. Owe show a schematic of a par- 
titioning of the (p, c)-plane into different regimes derived 
from a visual inspection of the dependencies m(p, c) and 
r{p,c) (lower part). In addition to the regimes already 
described above (cf. Fig. [6|), we observe random firing 



(regime la) for coupling strengths c < 0.28. The tran- 
sition to regime lib is independent on p. This is to be 
expected since our estimation for the critical coupling 
strength Cc does not depend on the network topology. 
For larger coupling strengths, the dynamics is influenced 
by the network topology, and particularly p < 0.4 allows 
for rich dynamical behavior. Counter intuitively, we ob- 
serve that an enhanced coupling strength can prevent the 
medium from periodic behavior (for example at p = 0.3 
and c = 0.5). Also an enhanced rewiring can prevent 
global oscillations (for example at c = 1.5 and p = 0.3). 
Regime Illb only exists for coupling strengths c > 1 and 
thus Ilia directly adjoins Ila for c < 1 as already observed 
for regular lattices. 

As the network activity of both regular lattices and 
random networks is determined - for large coupling 
strengths - by the charging of the medium due to spon- 
taneous firing, we here observe a low firing rate m. In 
the small- world regime, the medium is charged by the 
rewired connections of neurons on wave fronts, which 
leads to a high mean firing rate. 

Next, we study the stability of an initial spiral wave 
state depending on the coupling strength c and rewiring 
probability p. Since it is possible that the structure of 
a stable spiral changes with increasing p, initial condi- 
tions of a spiral wave taken from a regular lattice and 
applied to a small-world medium will possibly not lead 
to a stable spiral wave although such waves are still pos- 
sible for this rewiring probability. For our simulation we 
started with a spiral wave for p = 0, which was created 
by imposing an open wave ending as initial conditions 
(see Fig. [3]). After the emergence of a repetitive pattern 
and the usual measurement of m and r, we imposed the 
membrane potential of each neuron as initial conditions 
for a medium with a one percent higher p. This proce- 
dure was iterated until p = 1.0. At some step the spiral 
wave is not stable anymore and begins pulsating with 
increasing amplitudes, which leads to global oscillations. 
This instability occurs when the spatial distance between 
two waves is large enough for neurons to be exited un- 
til threshold by long-range connections. In Fig. [8] we 
present our findings along this procedure. Surprisingly, 
we observe wave-dominated behavior for 0.4 < p < 0.5 
and large c although in this regime global oscillations 
were stable when starting from Xn{0) = for all neu- 
rons. This is because the possibility of wave propagation 
depends on whether the medium shows global synchrony. 
For a wave traveling through a medium with global syn- 
chrony the mean excitation in the network x{t) increases 
on the way to collective firing. Wave propagation may 
only be possible at times where x{t) exceeds a certain 
level. In the case of a medium without global synchrony, 
however, the excitations from long-range connections are 
evenly distributed over time and allow for wave propaga- 
tion as do local connections. Waves are thus faster and 
are not moved backward during the collective firing as 
already mentioned above. Therefore, dynamical states of 
regime Ila and lib can both be stable for 0.4 < p < 0.5. 
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FIG. 7. Top: Schematic of the different regimes in the (p, c) plane 
of the parameter space. Lines were estimated by visually inspecting 
the dependence of the order parameter r (middle) and the mean firing 
rate m (bottom) on coupling strength c and rewiring probability p. 
Initial conditions: Xn{0) = for all neurons. The system was observed 
for 8000 time steps. I: random firing, II: self-sustaining patterns, III: 
cyclic waves, a: activity with only minor fiuctuations, b: collective 
firing. 



IV. CONCLUSIONS 

We investigated numerically the collective behavior of 
small- world networks of non-leaky IF neurons depending 
on the coupling strength c and the number of random 
connections p. We considered a radius of influence R 
for all nodes on the regular lattice underlying the small- 
world networks which, on the one hand, can be regarded a 
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FIG. 8. Same as Fig. [7]but for a spiral wave state as initial conditions. 



more reahstic setting with respect to neuroanatomy and, 
on the other hand, led to a complicated dependence of 
the network dynamics on the coupling strength. Particu- 
larly, we observed turbulent-like patterns which can prob- 
ably not be observed with nearest-neighbor couplings. 
Moreover, in the small- world regime, a radius of influ- 
ence R> 1 allowed for a fast and reproducible formation 
of spiral waves even without strong noisy inputs. Given 
our setup we observed different regimes in the (p, c)-plane 
which were characterized by different dynamical behav- 
iors of the network. We observed local patterns such as 
cyclic waves, spiral waves, and turbulent-like patterns. 
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For certain network parameters and depending on the set 
of initial conditions these patterns interfered with global 
collective firing of the neurons. Moreover, we observed 
in the same network different dynamics depending on 
the set of initial conditions only. Our observations in- 
dicate that both strength and topology of connections 
play an important role in determining the spatiotemporal 
dynamics of complex networks such as the brain during 
both physiological and pathophysiological conditions as 
can be observed e.g. in epilepsy. For the latter our find- 
ings are in line with those obtained from other modeling 
approaches'^* as well as with findings obtained from 
in vivo studies^ — and emphasize the need for more ex- 
perimental studies on functional and structural connec- 
tivity in real neural tissue. Progress along this line can be 
expected from recent methodological developments^^^^ 
that allow one to study neural network activity at high 
spatial and temporal resolution. 
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